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ABSTRACT 

The  success  of  Japanese  industry  in  producing  high  quality  products  at 
low  cost  is  cited.  Consideration  of  certain  aspects  of  scientific  method 
leads  to  discussion  of  recent  research  on  the  role  of  screening  designs  in  the 
improvement  of  quality.  A  projective  rationale  for  the  use  of  these  designs 
in  the  circumstances  of  factor  sparsity  is  advanced.  In  this  circumstance  the 
possibility  of  identification  of  sparse  dispersion  effects  as  well  as  sparse 
location  effect  is  considered.  A  new  method  for  the  analysis  of  fractional 
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factorial  designs  is  advanced. 
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A  traditional  philosophy  of  quality  control  has  been  to  "inspect  bad 
quality  out"  and  indeed  there  are  famous  military  standards  that  employ  this 
philosophy.  W.  Edwards  Deming  (1982)  has  likened  this  to  making  toast 
according  to  the  recipe  "you  burn  it  and  I'll  scrape  it",  and  has  urged  the 
alternative  philosophy  of  assuring  that  good  quality  has  been  built  in  to  the 
product  in  the  first  place.  In  particular  he  attributes  to  the  latter 
philosophy  the  success  of  Japanese  industry  in  producing  high  quality  products 
at  low  cost.  A  typical  example  of  the  dramatic  consequences  that  have  been 
attributed  to  these  differences  of  approach  are  the  air-conditioner  defect 
rates  shown  in  Table  1  and  quoted  by  David  Garvin  (1983). 


(In  the  factory:  Assembly  line  defects  per  100  units) 

American  Japanese 


Total  . 63.5  0.95 

Leaks  .  3.1  0.12 

Electrical  .  3.3  0.12 


(In  the  field:  Service  call  rate  per  100  units  under 
first  year  warranty  coverage) 

American  Japanese 


Total  .  10.5  0.6 

Compressors  .  1.0  0.05 

Thermostats  . 1.4  0.002 

Fan  motors  . 0.5  0.028 


TABLE  1.  Defect  rates  in  US  and  Japanese  air  conditioners 

Similar  comparisons  have  been  made  between  defect  rates  in  American  and 
Japanese  automobiles. 

The  same  United  States  industry  that  makes  air  conditioners  and  motor 
vehicles  also  makes  military  hardware.  It  seems  clear  therefore  that  a  major 
change  in  quality  philosophy  could  produce  a  major  improvement  in  the 
reliability  of  the  Army's  equipment.  The  philosophy  of  "building  quality  in" 
employs  a  policy  of  never  ending  quality  improvement  which  may  be  typified  in 
terms  of  the  traditional  statistical  model 
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where  y  is  a  quality  characteristic  believed  to  depend  on  a  set  of  variables 
denoted  by  whose  identity  is  known,  and  e  is  the  difference  y  -  f(,$.|) 

usually  referred  to  as  error .  (Such  "errors"  are  often  somewhat  arbitrarily 
imbued  by  the  theoretician  with  properties  of  randomness,  normality 
independence  and  homoscedasticity ) .  In  reality  e  is  a  function  e(x2)  a 

number  of  additional  variables,  say,  which  affect  the  system  but  whose 

identity  is  usually  unknown.  In  general,  quality  improvement  is  achieved  by 
transferring  elements  of  the  unknown  factor  vector  jCj  into  the  known  factor 
vector  3<1  as  indicated  below 


y  =  f(x1 )  +  e(x2 ) 

known  unknown 

The  effect  of  such  transfer  is  two-fold 

(i)  to  reveal  effects  of  previously  unknown  factors  which  may  then  be 

adjusted  to  levels  yielding  higher  quality  and/or  used  to  control  the 
process. 

(ii)  to  remove  variation  previously  caused  by  haphazard  changes  in  these 
factors. 

Some  of  the  statistical  techniques  which  contribute  to  this  transfer  are 
quality  control  charting  (including  Shewhart,  Cusum,  Pareto  and  Fishbone 
charts)  and  designed  experimentation  on  line  and  off  line  (employing  in 
different  and  appropriate  contexts  factorial,  fractional  factorial  and 
orthogonal  array  designs,  evolutionary  operation  and  response  surface 
methods ) . 


2.  SCIENTIFIC  METHOD  AND  QUALITY 

Charting  and  experimentation  are  examples  respectively  of  passive 
surveillance  and  active  intervention  both  of  which  are  important  elements  in 
scientific  method  which  it  is  desirable  to  consider  further. 

Humans  differ  from  other  animals  most  remarkably  in  their  ability  to 
learn.  It  is  clear  that  although  throughout  the  history  of  mankind 
technological  learning  has  taken  place,  until  three  or  four  hundred  years  ago 
change  occurred  very  slowly.  One  reason  for  this  was  that  in  order  to  learn 
something  -  for  example,  how  to  make  fire  or  champagne  -  two  rare  events 
needed  to  coincides  (a)  an  informative  event  had  to  occur,  and  (b)  a  person 
able  to  draw  logical  conclusions  and  to  act  on  them  had  to  be  aware  of  that 
informative  event. 

Passive  surveillance  is  a  way  of  increasing  the  probability  that  the  rare 
informative  event  will  be  constructively  taken  note  of  and  is  exemplified  by 
quality  charting  methods.  Thus  a  Shewhart  chart  is  a  means  to  ensure  that 


possibly  informative  events  are  brought  to  the  attention  of  those  who  may  be 
able  to  discover  in  them  an  "assignable  cause"  (Shewhart  1931)  and  act 
appropriately . 

Active  intervention  by  experimentation  aims,  in  addition,  to  increase  the 
probability  of  an  informative  event  actually  occurring.  A  designed  experiment 
conducted  by  a  qualified  experimenter  can  dramatically  increase  the 
probability  of  learning  because  it  increases  simultaneously  the  probability  of 
an  informative  event  occurring  and  also  the  probability  of  the  event  being 
constructively  witnessed.  Recently  there  has  been  much  use  of  experimental 
design  in  Japanese  industry  particularly  by  Genichi  Taguchi  (Taguchi  and  Wu 
(1980))  and  his  followers.  In  off-line  experimentation  he  has  in  particular 
emphasized  the  use  of  highly  fractionated  designs  and  orthogonal  arrays  and 
the  minimization  of  variance. 

In  the  remainder  of  this  paper  we  briefly  outline  some  recent  research  on 
the  use  of  experimental  design  in  the  improvement  of  quality. 


3.  USE  OF  SCREENING  DESIGNS  TO  IMPROVE  QUALITY 


Table  2  shows  in  summary  a  highly  fractionated  two-level  factorial  design 
employed  as  a  screening  design  in  an  off-line  welding  experiment  performed  by 
the  National  Railway  Corporation  of  Japan  (Taguchi  and  Wu,  1980).  In  the 
column  to  the  right  of  the  table  is  shown  the  observed  tensile  strength  of  the 
weld,  one  of  several  quality  characteristics  measured. 

The  design  was  chosen  on  the  assumption  that  in  addition  to  main  effects 
only  the  two-factor  interactions  AC,  AG,  AH,  and  GH  were  expected  to  be 
present.  On  that  supposition,  all  nine  main  effects  and  the  four  selected 
two-factor  interactions  can  be  separately  estimated  by  appropriate  orthogonal 
contrasts,  the  two  remaining  contrasts  corresponding  to  the  columns  labelled 
e^  and  e2  measure  only  experimental  error.  Below  the  table  are  shown  the 
grand  average,  the  fifteen  effect  contrasts,  and  the  effects  plotted  on  a  dot 
diagram.  When  the  effects  are  plotted  on  normal  probability  paper,  thirteen 
of  them  plot  roughly  as  a  straight  line  but  the  remaining  two,  corresponding 
to  the  main  effects  for  factors  B  and  C,  fall  markedly  off  the  line, 
suggesting  that  over  the  ranges  studied,  only  factors  B  and  c  affect 
tensile  location  by  amounts  not  readily  attributed  to  noise. 

If  this  conjecture  is  true,  then,  at  least  approximately,  the  sixteen 
runs  could  be  regarded  as  four  replications  of  a  22  factorial  design  in 
factors  B  and  C  only.  However,  when  the  results  are  plotted  in  Figure  1 
so  as  to  reflect  this,  inspection  suggests  the  existence  of  a  dramatic  effect 
of  a  different  kind  -  when  factor  C  is  at  its  plus  level  the  spread  of  the 


To  facilitate  later  discussion  we  have  set  out  the  design  and  labelled  the 
levels  somewhat  differently  from  Taguchi. 
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TABLE  2.  A  fractional  two-level  design  used  in  a  welding  experiment  showing  observed  tensile 
strength  and  effects.  Below  the  estimated  effects  are  plotted  as  a  dot  diagram. 


data  appears  much  larger  than  when  it  is  at  its  minus  level.  Thus,  in 
addition  to  detecting  shifts  in  location  due  to  B  and  C,  the  experiment 
may  also  have  detected  what  we  will  call  a  dispersion  effect  due  to  C.  The 
example  raises  the  general  possibility  of  analyzing  unreplicated  designs  for 
dispersion  effects  as  well  as  for  the  more  usual  location  effects. 
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Drying  Period  B 


Figure  1.  Tensile  data  as  four  replicates  of  a  2  factorial 
design  in  factors  B  and  C  only. 


*Data  of  this  kind  might  be  accounted  for  by  the  effect  of  one  or  more 
variables  other  than  B  that  affected  tensile  strength  only  at  the  "plus 
level"  of  C  (only  when  the  alternative  material  was  used).  Analysis  of  the 
eight  runs  made  at  the  plus  level  of  C  does  not  support  this  possibility, 
however . 


4.  RATIONALES  FOR  USING  SCREENING  DESIGNS 


Before  proceeding  we  need  to  consider  the  question,  "In  what  situations 
are  screening  designs,  such  as  highly  fractionated  factorials,  useful?" 

4.1.  Effect  Sparsity 

A  common  industrial  problem  is  to  find  from  a  rather  large  number  of 
factors  those  few  that  are  responsible  for  large  effects.  The  idea  is 
comparable  to  that  which  motivates  the  use  in  quality  control  studies  of  the 
"Pareto  diagram."  (See,  for  example,  Ishikawa  (1976)).  The  situation  is 
approximated  by  postulating  that  only  a  small  proportion  of  effects  will  be 
"active"  and  the  rest  "inert" .  We  call  this  the  postulate  of  effect 
sparsity.  For  studying  such  situations,  higly  fractionated  designs  and  other 
orthogonal  arrays  (Finney  (1945),  Plackett  and  Burroan  (1946),  Rao  (1947), 
Taguchi  and  Wu  (1980))  which  can  screen  moderately  large  numbers  of  variables 
in  rather  few  runs  are  of  great  interest.  Two  main  rationalizations  have  been 
suggested  for  the  use  of  these  designs;  both  ideas  rely  on  the  postulate  of 
effect  sparsity  but  in  somewhat  different  ways. 

4.2.  Rationale  Based  on  Prior  Selection  of  Important  Interactions 

It  is  argued  (see  for  example  Davies  (1954))  that  in  some  circumstances 
physical  knowledge  of  the  process  will  make  only  a  few  interactions  likely  and 
that  the  remainder  may  be  assumed  negligible.  For  example,  in  the  welding 
experiment  described  above  there  were  36  possible  two-factor  interactions 
between  the  nine  factors,  but  only  four  were  regarded  as  likely,  leaving  32 
such  interactions  assumed  negligible.  The  difficulty  with  this  idea  is  that 
in  many  applications  the  picking  out  of  a  few  "likely"  interactions  is 
difficult  if  not  impossible.  Indeed  the  investigator  might  justifiably 
protest  that,  in  the  circumstance  where  an  experiment  is  needed  to  determine 
which  first  order  (main)  effects  are  important,  it  is  illogical  that  he  be 
expected  to  guess  in  advance  which  effects  of  second  order  (interactions)  are 
important . 

4.3.  Projective  Rationale  Factor  Sparsity 

A  somewhat  different  notion  is  that  of  factor  sparsity.  Thus  suppose 
that,  of  the  k  factors  considered,  only  a  small  subset  of  unknown  size  d, 
whose  identity  is  however  unknown ,  will  be  active  in  providing  main  effects 
and  interactions  within  that  subset.  Arguing  as  in  Box  and  Hunter  (1961)  a 

two-level  design  enabling  us  to  study  such  a  system  is  a  fraction  of 

resolution  R  =  d  +  1  (or  in  the  terminology  of  Rao  (1947)  an  array  of 
strength  d)  which ^produces  complete  factorials  (possibly  replicated)  in 

every  one  of  the  J  spaces  of  d  =  R  -  1  dimensions.  For  example,  we  have 

seen  that  on  the  assumption  that  only  factors  B  and  C  are  important,  the 
welding  design  could  be  regarded  as  four  replicates  of  a  2  factorial  in 
just  those  two  factors.  But  because  the  design  is  of  resolution  R  =  3  the 
same  would  have  been  true  for  any  of  the  36  choices  of  two  out  of  the  nine 
factors  tested.  Thus  the  design  would  be  appropriate  if  it  were  believed  that 
not  more  than  two  of  the  factors  were  likely  to  be  "active". 


Columns  1  2  3  4  5  6  7  8  9  10  1  1  12  13  14  15 


(a) 

(b) 


,15-11 
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8-4 

IV 


(c) 


2 


5-1 

v 


(d)  24 


TABLE  3.  Some  alternative  uses  of  the  orthogonal  array  of  Table  2. 


For  further  illustration  we  consider  again  the  sixteen-run  orthogonal 
array  of  Table  2  and,  adopting  a  roman  subscript  to  denote  the  resolution  R 
of  the  design,  we  indicate  in  Table  3  various  ways  in  which  that  array  might 
be  used.  It  may  be  shown  that 


(a)  If  we  associated  the  fifteen  contrast  columns  of  the  design  with 

1 5— 11 

fifteen  factors,  we  would  generate  a  design  providing  four-fold 

replication  of  2^  factorials  in  every  one  of  the  105  two-dimensional 
projections . 


(b)  If  we  associated  only  columns  1,  2,  4,  7,  8,  11,  13,  and  14  with 
eight  factors  we  would  agenerate  a  2®y4  design  providing  two-fold 
replication  of  23  factorials  in  every  one  of  the  56  three-dimensional 
projections . 


(c)  If  we  associated  only  columns  1,  2,  4,  8,  and  15  with  five  factors 
we  would  generate  a  2y-1  design  providing  a  24  factorial  in  every  one  of 
the  four-dimensional  projections. 


(d)  If  we  associated  only  columns  1,  2,  4,  and  3  with  four  factors  we 
would  obtain  the  complete  24  design  from  which  this  orthogonal  array  was  in 
fact  generated. 


Designs  (a),  (b)  and  (c)  would  thus  be  appropriate  for  situations  where  we 
believed  respectively  that  not  more  than  2,  3,  or  4  factors  would  be 

active  •  Notice  that  intermediate  values  of  k  could  be  accommodated  bv 

9-5 

suitably  omitting  certain  columns.  Thus  the  welding  design  is  a  2Il:l 
arrangement  which  can  be  obtained  by  omitting  6  columns  from  the  complete 
^III^  *  Notice  finally  that  for  intermediate  designs  we  can  take  advantage  of 
both  rationales  by  arranging,  as  was  done  for  the  welding  design,  that 
particular  interactions  are  isolated. 


* 

The  designs  give  partial  coverage  for  a  larger  number  of  factors,  lor  example 

Q  — 4 

(Box  and  Hunter  (1961))  56  of  the  70  four-dimensional  projections  of  the  2'^v 
yield  a  full  factorial  in  four  variables. 


A  discussion  of  the  iterative  model  building  process  by  Box  and  Jenkins 
(1970)  characterized  three  steps  in  the  iterative  data  analysis  cycle 
indicated  below 


r 


identification 


fitting 


->  diagnostic  checking  -j 


Most  of  the  present  paper  is  concerned  with  model  identification  -  the  search 
for  a  model  worthy  to  be  formally  entertained  and  fitted  by  an  efficient 
procedure  such  as  maximum  likelihood.  The  situation  we  now  address  concerns 
the  analysis  of  fractional  designs  such  as  the  welding  design  in  the  above 
context  when  only  a  few  of  the  factors  are  likely  to  have  effects  but  these 
may  include  dispersion  effects  as  well  as  location  effects. 


5.  DISPERSION  EFFECTS 


We  again  use  the  design  of  Table  2  for  illustration.  There  arn  16  runs 

from  which  16  quantities  —  the  average  and  15  effect  contrastr  •  been 

calculated.  Now  if  we  were  also  interested  in  possible  dispe  -  •  effects  we 

could  also  calculate  15  variance  ratios.  For  example,  in  colv^nn  1  we  can 

compute  the  sample  variance  s2_  for  those  observations  associa  er  ith  a 

minus  sign  and  compare  it  with  the  sample  variance  ai.  for  obsej.  .ations 

'  *  o  2 

associated  with  a  plus  sign  to  provide  the  ratio  F1  =  s^_/s1+.  If  this  is 
done  for  the  welding  data  we  obtain  values  for  lnF^*  given  in  Figure  2(a). 

It  will  be  recalled  that  in  the  earlier  analysis  a  large  dispersion  effect 
associated  with  factor  C  (column  15)  was  found,  but  in  Figure  2(a)  the 
effect  for  factor  C  is  not  especially  extreme,  instead  the  dispersion  effect 
for  factor  D  (column  1)  stands  out  from  all  the  rest.  This  misleading 
indication  occurs  because  we  have  not  so  far  taken  account  of  the  aliasing  of 
location  and  dispersion  effects.  Since  sixteen  linearly  independent  location 
effects  have  already  been  calculated  for  the  original  data,  calculated 
dispersion  effects  must  be  functions  of  these.  Recently  (Box  and  Meyer  1984a) 
a  general  theory  of  location-dispersion  aliasing  has  been  obtained  for 
factorials  and  fractional  factorials  at  two  levels.  For  illustration,  in  this 
particular  example  it  turns  out  that  the  following  identity  exists  for  the 
dispersion  effect  F1#  that  is  the  F  ratio  associated  with  factor  D  and 
hence  for  column  1  of  the  design. 


F 


1 


^  ^  rt  a  A  —  A  A  A  A  ^  A  A  A  A  n  A  A 

(2-3)  +(4-5)  +(6-7)  +(8-9 )  +(10-11)  +  ( 12-13)  +  ( 14-15) 
(2+3)2+(4+5)2+(6+7)2+(8+9)2+(10+11 )2+( 12+13 )2+( 14+15) 


2 


2 


(1) 


Now  (see  Table  2)  14  =  B  =  2.15  and  15  =  C  =  3.10  are  the  two  largest 

location  effects,  standing  out  from  all  the  others.  The  extreme  value  of  F-j 
associated  with  an  apparent  dispersion  effect  of  factor  D ( 1 )  is  largely 


*In  this  figure  familiar  normal  theory  significance  levels  are  also  shown. 
Obviously  the  necessary  assumptions  are  not  satisfied  in  this  case,  but  these 
percentages  provide  a  rough  indication  of  magnitude. 
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accounted  for  by  the  squared  sum  and  squared  difference  of  the  location 
effects  B  and  C  which  appear  respectively  as  the  last  terms  in  the 
denominator  and  numerator  of  equation  { 1 ) .  A  natural  way  to  proceed  is  to 
compute  variances  from  the  residuals  obtained  after  eliminating  large  location 
effects.  After  such  elimination  the  alias  relations  of  equation  (1)  remain 
the  same  except  that  location  effects  from  eliminated  variables  drop  out. 

That  is  zeros  are  substituted  for  eliminated  variables.  Variance  analysis  for 
the  residuals  after  eliminating  effects  of  B  and  C  are  shown  in  Figure 
2(b).  The  dispersion  effect  associated  with  C  (factor  15)  is  now  correctly 
indicated  as  extreme.  It  is  shown  in  the  paper  referenced  above  how,  more 
generally,  under  circumstances  of  effect  sparsity  a  location-dispersion  model 
may  be  correctly  identified  when  a  few  effects  of  both  kinds  are  present. 


6.  ANALYSIS  OF  UNREPLICATED  FRACTIONAL  DESIGNS 


Another  important  problem  in  the  analysis  of  unreplicated  fractional 
designs  and  other  orthogonal  arrays  concerns  the  picking  out  of  "active" 
factors.  A  serious  difficulty  is  that  with  unreplicated  fractional  designs  no 
simple  estimate  of  the  experimental  error  variance  against  which  to  judge  the 
effects  is  available. 


In  one  valuable  procedure  due  to  Cuthbert  Daniel  (1959,  1976)  effects  are 
plotted  on  Normal  probability  paper.  For  illustration  Table  4  shows  the 
calculated  effects  from  a  2®y  design  used  in  an  experiment  on  injection 
molding  (Box,  Hunter  and  Hunter,  1978,  p.  399).  These  effects  are  plotted  on 
normal  probability  paper  in  Figure  3. 


T i  =  -0.7  +  1 
T2  =  -0.1  +  2 
T3  =  5.5  +  3 
T4  =  -0.3  4 
T5  =  -3.8  *  5 
Tg  =  -0.1  +6 
T7  =  0.6  *  7 
Tg  =  1.2+8 


mold  temp, 
moisture  content 
holding  pressure 
cavity  thickness 
booster  pressure 
cycle  time 
gate  size 
screw  speed 


Tg  —  1*^,2  —0.6  + 

T10  "  T1 *3  =  °*9  + 

Tn  =  t1.4  =  -°*4  + 
Ti2  =  T1>5  =  4.6  + 

T13  =  t1.6  =  -°-3  * 

TU  =  t1>7  =  -0.2  + 

T15  “  t1.8  =  _0,6  + 


1.2 

+ 

3.7 

+ 

4.8 

+ 

5.6 

1.3 

+ 

2.7 

+ 

4.6 

+ 

5.8 

1.4 

+ 

2.8 

+ 

3.6 

+ 

5.7 

1 .5 

+ 

2.6 

+ 

3.8 

+ 

4.7 

1.6 

+ 

2.5 

+ 

3.4 

+ 

7.8 

1.7 

+ 

2.3 

+ 

6.8 

+ 

4.5 

1 .8 

+ 

2.4 

+ 

3.5 

+ 

6.7 

8—4 

TABLE  4.  Calculated  effects  from  a  2|v  design  showing 

alias  structure  assuming  three  factor  and  higher  order 
interactions  negligible.  Injection  molding  experiment. 
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An  alternative  Bayesian  approach  (Box  and  Meyer,  1984b)  is  as  follows: 
Let  T1 *  *  * 'Tv  be  standardized  effects  with 

if  effect  inert 

T,  =  e(  +  T .  if  effect  active 
ill 

2  ,  2 
o+o 

ei  +  N(0,oZ),  t  +  N(0,a2)  k2  =  - - — -  . 

Suppose  the  probability  that  an  effect  is  active  is  a. 


Let  S(r)  be  the  event  that  a  particular  set  of  r  of  the  v  factors 
are  active,  and  let  3>(r)  be  the  vector  of  estimated  effects  corresponding  to 
active  factors  of  a(r)*  Then,  (Box  and  Tiao,  1968)  with  p(0)  <*  —  the 
posterior  probability  that  T  are  the  only  active  effects  is: 


P[a 


(r) 


|T,a/k] 


0C 


j  {l  -  (1  - 


where  S(rj  =  2(r)X(r)  and  s  =  JE’I*  In  particular  the  marginal  probability 
that  an  effect  i  is  active  give  T,  a  and  k  is  proportional  to 


I  ir=ii  i'  -  <<  - 


-1 


(r) 

i  active 


(r)  i 


A  study  of  the  fractional  factorials  appearing  in  Davies  (1954),  Daniel 
(1976)  and  Box,  Hunter  and  Hunter  (1978)  suggested  that  a  might  range  from 
0.15-0.45  while  k  might  range  from  5  to  15.  The  posterior  probabilities 
computed  with  the  (roughly  average)  values,  a  =  0.30  and  k  =  10  are  shown 
in  Figure  4(a)  in  which  N  denotes  the  probability  (negligible  for  this 
example)  that  there  are  no  active  effects.  The  results  from  a  sensitivity 
analysis  in  which  a  and  k  were  altered  to  vary  over  the  ranges  mentioned 
above  is  shown  in  Figure  4(b). 


It  will  be  seen  that  Figure  4(a)  points  to  the  conclusion  that  active 
effects  are  associated  with  columns  3,  5  and  12  of  the  design  and  that  column 
8  might  possibly  also  be  associated  with  an  active  factor.  Figure  4(b) 
suggests  that  this  conclusion  is  very  little  affected  by  widely  different 
choices  for  a  and  k.  Further  research  with  different  choices  of  prior, 
with  marginization  with  respect  to  k,  and  with  different  choices  of  the 
distribution  assumptions  is  being  conducted. 


*For  three-level  and  mixed  two  and  three  level  designs  for  example,  this 
analysis  is  carried  out  after  the  effects  are  scaled  so  that  they  all  have 
equal  variances. 
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7.  OTHER  RESEARCH 


Topics  which  are  emphasized  in  Taguchi's  approach  to  "off  line  quality 
control"  are  (a)  reduction  of  variation  by  error  transmission  studies  and  (b) 
the  choosing  of  a  product  design  so  that  it  is  robust  with  respect  to 
environmental  variables . 

These  topics  are  also  receiving  attention  in  further  research. 
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